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PANT CREY. CAcIrOR 
ABSTRACT 

The Fleet Numerical Facility (FNWF) 500-mb long-wave prognoses at 
latitudes 20N through 70N were analyzed statistically for possible error- 
bias. FNWF issued a correction field (verified minus prognostic) for 
each latitude circle and day under study as well as the initial height 
field 48 hours earlier. 

Fourier analyses of both the correction fields and the initial 
height fields were made. Spectral analyses of the correction fields 
indicated that more than 60% of the error lay in correction-waves 1, 2, 
and 3 at all latitudes and that this figure increased northward. 

Persistency correlations were made between the initial height fields 
and the correction fields. The results indicated a carry-over of per- 
sistency into the final 48-hr forecast, especially in the cases of 
heights which were initially considerably above or below the normal 
heights. 

The final phase of the study dealt with the question of stabiliza- 
tion of the ultra-long waves (1, 2, and 3), using the present operational 
barotropic model. The model seems to retard waves 1 and 3 at the lower 
and middle latitudes, and to move them too far at high latitudes. The 
results for wave 2 are somewhat less conclusive, but are generally in 
agreement with those for waves 1 and 3. 

The authors wish to express their sincere appreciation to Professor 
Frank L. Martin, Department of Meteorology and Oceanography, U. S. Naval 
Postgraduate School, for his suggestion of the topic and assistance in 


the preparation of this study. 
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ate Introduction. 

Fleet Numerical Weather Facility (henceforth referred to as FNWF) 
issues a 48-hr "long wave" prognosis for 500 mb. This forecast is 
issued twice daily (00Z and 12Z) and is based upon a smoothed version 


of their conventional 48-hr map. The smoothing is performed by means of 


the operator 
iy. 
7,7 Ye (2 +Z,+2,4+2,\+ 2 z. | 


which reduces the amplitudes of the short waves while leaving that of 
the long waves relatively unchanged. 

FNWF provided the authors with 36 daily values of the forecast and 
verifying heights at 10° longitude intervals along each of the six 
latitude circles 20 through 70N. In addition, they also provided for 
each case similar data from the analyzed chart which Served as the 
initial-data chart 48 hours earlier. The authors then examined, by 
statistical means, the hypothesis that the correction field (i.e., the 
set of correction values, as a function of latitude L and longitude r , 
necessary to convert the forecast long-wave chart to the verifying 
chart) was at least partially determined or biased by the original 


analysis used in starting the 500-mb prognosis. 
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Zc. Data Sources. 

As mentioned in the previous section, the primary data-charts used 
in this study were the analyzed 500-mb long-wave charts at 0000 GCT 
together with the "correction" long-wave charts timed 48 hours later. 

The data were restricted to the month of December 1962, so that it was 
possible to make a total of 29 comparisons between initial and correction 


charts. 








3% Statistical Techniques. 
(a) Spectral Analysis of the Correction Field 
Before any relationships between the correction and initial 
fields were sought, it was decided to investigate the spectral character- 
istics of the correction field. This was done by expressing the 
"correction" long-wave field, denoted Wr) » as the sum of twelve 


harmonic waves by Fourier analysis: 


12 

r 

Vr) = 2X, + i ce COS ee +B. sin amr (1) 
S=! 


where § = wave number (1 through 12). 


36 is the number of data points on each latitude circle 


n 


r ait, l5e2; .++,  -l is a distance scale numbered in equalli— 


Spaced data points measured westward from Greenwich. 


Then the spectral contribution of the Sth harmonic in Yr) is given by 


Z 2 
V2 (x, + 8.) or V/z = a 


The last statement implies that (2) has been expressed in the equivalent 


form 





21 
Mir) = hX~o + C, cos ( SL P,) (3) 
| 4 5 
where ay is the phase angle. It has been found more convenient in 


this study to use phase "shift" ’. rather than phase angle. This 


is done by expressing Vir) as 


Yir) = 2%, + Cc, cosfs( 226 . P ) (4) 


The advantage of using (4) over (3) is that it enables one to 


keep track of the same identifiable feature (for example, the ridge 
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closest to Greenwich) for each wave number 

Using the CDC-1604 digital computer, the Fourier series was 
derived for each latitude and day. Use was made of the FORTRAN program 
"Periodogram Analysis" written by R. R. Hilleary [3] of the U. S. Naval 
Postgraduate School Computer Center staff. The program-output gave for 
each wave number S , each latitude and day under consideration, the 
following: 


(1) Amplitude C. and spectral value ep. 


(2) Phase angle ve and phase shift ?. = WE 

(3) Mean value of Y and the total variance of Yr) 

(4) Percent contribution of the §th wave to total variance 

of Y(r) 

In this subsection, attention was focused upon item 4, that is, 
relative spectral contributions of the various correction-field waves. 
In order to obtain representative values, the 29 daily percent contribu- 
tions by waves were averaged to give the December 1962 mean relative- 
percentage contributions to variance of the correction field. The 
resulting percentages are displayed in table 1, both as a function of 
latitude and wave number. 

In addition, any wave listed in table 1 which contributed, in 
the mean, more than 10% of the variance at its indicated latitude has 
been subjected to frequency analysis using histograms. The waves so 
examined are indicated in table 1 by an asterisk following the appro- 
priate percentage contribution. Waves 1 to 4 fall into this category at 
latitudes 20 through 50, while waves 1 to 3 contribute more than 10% at 
all latitudes 20 through 70. Wave 6 contributes more than 10% at 


latitude 60, but all other values of all waves fall below 10%. 
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Table 1. Mean explained percentage contribution to the total variance of 


the correction field by wave number and latitude. 


_20N _30N _4ON = SON. _60N_-_7ON 
Wave No. l 14.5* 2s 20.9% 16.7* 30.3% 35.2% 
Wave No. 2 17.7* 16.9* ede Ks 25.3" 26.6% 32025 
Wave No. 3 28.9% Doel, 18.9* 14.5% 15.9% 16.2% 
Wave No. 4 16.6* 12.8% 12.1% 10.9* 8.1 9.5 
Wave No. 5 6.5 6.2 5.9 6.8 8.4 30 
Wave No. 6 a2 9 4.7 Tae 10.1* 4.7 23 
Wave No. 7 3.3 4.5 4.9 7.3 2.8 La 
Wave No. 8 2.0 2.9 3.0 2.3 13 0.4 
Wave No. 9 1.8 Sh v2 2.6 1.8 0.6 O23 
Wave No. 10 1.5 2.1 1.4 0.9 0.4 0.1 
Wave No. 11 0.7 1.4 La2 0.9 0.3 O.1 
Wave No. 12 0.9 0.7 Oy 0.7 O71 0.0 
Total 
Explained 
Variance 98.3 98.7 98.7 98.2 ooo 9979 


* Denotes wave contributing more than 10% to the correction field at 
the indicated latitude. 


The histograms drawn are shown in the Appendix as figures 1-6 
(in order of increasing latitude) for wave 1, figures 7-12 for wave 2, 
figures 13-18 for wave 3, figures 19-22 for wave 4, and figure 23 for 
wave 6. Note that all these diagrams present in the upper half a fre- 
quency distribution with regard to wave amplitude; and in the lower half 
a frequency distribution of the phase shift giving the correction-wave 


ridge closest to Greenwich. 


ais 





As an example of the type of conclusion which may be drawn 
from these histograms, one may compare figure 1 with figure 6, both 
dealing with wave 1. Figure 1 indicates that wave 1 has a small mean 
amplitude (66 feet) and a mean ridge position at -15W longitude*. By 
contrast, figure 6 has a mean amplitude of 155 feet and a mean correction 
phase shift of -7W longitude*. However, note that frequency distribu- 
tions of the phase shift appear to be random in both cases, though not a 
Gaussian distribution in either caSe. 

The same general latitudinal variation occurs with wave 2 in 
passing from latitudes 20N to 7ON. At 20N there is only a Small mean 
amplitude (about 60 feet) and a random distribution of phase shifts 
centered around a mean of 50W, whereas at latitude 7ON the wave 2 cor- 
rection field had an amplitude of 150 feet and a phase shift of 15W. 
This means that the trough in the wave 2 correction field at 70N would 
be located at 105W in December. 

The mean values of amplitudes and phase shifts in figures 1-23 
have been computed and are displayed by each histogram. It is not known 
whether such means have any real Significance. Of course it is possible 
that the correction field histograms depicted show real prognostic 
anomalies which the barotropic forecast model cannot resolve, and are 
applicable to December in general. One approach in determining whether 
these correction-waves have real statistical significance is to test the 
cross-correlation between correction and harmonic waves by latitude and 
wave number 
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* Note that all FNWF long-wave information was printed in terms of 
degrees west longitude so that the two phases mentioned above are 15° 
and 7 east longitude. 
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for significance. The expression on the right side of (5) is given by 
Kahn [4]. Actually this test was not performed, mainly because a 
simpler approach, described below, was applied. 
(b) Correlation Investigation of Anomalies 

A FORTRAN data-sorting program was written for each latitude 
and all of the 29 days. This program sorted out abnormally high and low 
contour values in the 29-day sample, and a correlation subroutine com- 
puted the correlation between the initial contour height at the latitude- 
longitude intersection Chr ) and the forecast-correction value verify- 
ing two days later. The sorting program was designed to divide the 
29 x 36 value sample at each latitude into classes as follows: 

(I) Those heights more than one standard deviation above the 
sample mean height (approximately 16% if the heights are 
normally distributed). 

(II) Those heights smaller than the mean by at least one 
standard deviation. 

(IIL) The remaining 68% of the heights between extremes (I) 
and (II). 

The linear correlations obtained for each latitude and class 

are listed in table 2 below. 


Table 2. Linear correlations between initial height fields and 48-hr 
verification-correction values. 


20N 30N 4ON 50N 60N 70N 
Class I 0.08 -0.01 0.02 0.16 0 06 -0.41 
Class II -0.29 ~0.17 -0.13 0.09 0.15 ~0.22 
Class III -0.03 -0.13 OnGe ~0.12 -0.03 -0.13 


If we make the assumption that half of the data-sample pairs are 


uncorrelated, significance tests for each class will be based upon the 


aoe 





reduced sample sizes N = 84, 84, and 354, respectively, for classes I, 
II and III. For these sample sizes, the following critical values [ 
of the linear correlation coefficient are applicable (see Dixon and 


Massey [1957, p. 468] at the 99% confidence level )- 


(I) N= 8 = 0.27 
(II) N= 8 fr = 0.27 
(III) N= 354 i = 0.13 


A significant negative correlation between correction values 
and the 500-mb heights two days earlier indicates that initially above- 
average heights tend to perpetuate themselves unduly in the prognoses 
two days later. This effect of persistence is most marked with classes 
and II, which are already considerably above or below normal. The most 
significant correlations in these classes correspond to (I, 70ON) and 
(II, 20N) with rf z= -0.41 and -0.29, respectively. Generally, class II 
shows a Pensa iain of near-significant negative values (see lati- 
tudes 30, 40, and 70N in addition to latitude 20N), which tend to bear 
out the comments made previously with respect to the effects of per- 
sistence. 

Conversely, class III, even with the large number of "inde- 
pendent" pairs, has no definitely significant correlation coefficients. 
These results suggest that the FNWF barotropic model appears to handle 
| weak ridges and troughs quite well. 

(c) Persistence of the Ultra-Long Waves 

As mentioned in section 3(a), the frequency distributions of 
correction-wave phase shifts $. shown in figures 1-23 cannot be 
expected to apply for another December forecast series. Moreover, while 


the frequency distributions do not appear to be normally distributed, 


Spe 





there is an element of randomness about them in terms of values of p. 

relative to Greenwich. Hence, a relative test concerningthe efficacy 

of the correction-wave phase shift . has been devised. In this test, 

attention is focused only on the harmonic waves § 21, 2, 3, called 
" ultra-long waves. 

The barotropic model employed by FNWF makes use of a long-wave 
"stabilization" term called the Helmholtz correction term. This term is 
due to the initial work of Wolff [6] and Cressman [7], and was devised 
specifically to keep waves § =1, 2, 3 stationary, whereas the previous 
version of the barotropic model permitted spurious movement of these 
waves. For the purpose of testing whether these waves were stabilized, 


the variable 


4¢= i, 1 (6) 


which may be termed "relative phase shift,'’ was computed at each latitude 
for each day and wave numbers S$ £1, 2, 3. In (6) the symbol P, -2 
represents the phase of the Sth Fourier wave derived from the analysis 
two days previous to the long-wave prognosis. In (6) both P. and 2-2 
denote the meridians of the forecast-correction and initial waves closest 
to the Greenwich meridian. It was considered, in this section of the 
work, that if A P lay in the range -5 to +5 for the 48-hr forecast 
period, the wave was actually stabilized and such values of Ag were 
termed "'zero" for the purposes of this investigation. 

Values of | a¢ | larger than 5° longitude were considered to 
be exact, and the number of positive, negative and "'zero'' values occurring 


in each sample of 29 cases are listed in table 3 for each latitude. In 


addition, mean values of Ad and mean magnitudes [4$] have beer listed. 
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Table 3. 


3 Wave No. 2 Wave No. 1 


Wave No. 


Latitude 


Z0N 
30N 
4ON 
SON 
60N 
70N 


20N 
30N 
40N 
50N 
60N 
70N 


20N 
30N 
40ON 
50N 
60N 
70N 


* Latitude 20N not included in test. 


Mean 
A 


oe ae 
“41.3 
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Signs of A ¢ 
Positive Negative 
17 Te 
6 22 
2 25 
6 23 
13 15 
14 15 
22 5 
11 14 
11 15 
12 16 
8 z20 
13 14 
17 10 
8 19 
6 22 
13 14 
12 13 
17 10 


Some statistics on the behavior of relative phase shift. 


Zero 


or Of K- © 


ho m= em Lo & AD 


Signifi- 
cance 
Level 


# 


0.2% 
0.27% 
0.2% 


Za Z 


Ly ms 


1.2% 


z= 


2.6% 
0.2% 


12.4% 


N Indicates the distribution of signs is not significantly dif- 


ferent from a "chance" distribution. 


The first of these gives a ready answer to the queStion of the 48-hr dis- 


placement of the ultra-long correction-waves in degrees west longitude. 


From table 3a, it appears (see column 1, excluding latitude 20N) that: 


Wave 1 correction field is over-displaced to the east in latitudes 


30-50N, but is displaced westward at 60 and 70N. 


displaced at high latitudes. 


Wave 2 is slightly over-displaced at all latitudes. 


Wave 3 is over-displaced at low latitudes (30, 40N), but negatively 


Significance levels have not been ascribed to mean Ad values in 


table 3, so that the conclusions on displacement proposed just above are 


only tentative and subject to further testing, for example using the t -test. 


-10- 






7 oe et Pm | ~ 


OeRTY THPETE Grete 
mii Lees So 
7 Ld 


nn es, 








: 
' 
| 











A test has also been applied to the signs contained in the sign 


column of table 3. The significance levels have been determined (using 


table 10a, p 418 of Dixon and Massey, 1957) and the implication is that, 


at these levels, the combination of positive and negative signs could 


only occur with a probability equal to the quoted level in table 3, 


assuming either type of sign were equally probable. 


The conclusions to be drawn from the sign-significance tests as 


applied to table 3 are as follows; 


(a) 


(Dd) 


(c) 


For wave 1 there is strong evidence that the ultra-long 
waves require displacement to the east relative to the 
prognostic location at latitudes 30, 40, and 50N in a 
majority of the cases. This result is in agreement with 
that noted earlier in connection with the value of the 
mean & a ° 

For wave 2 at higher latitudes (60N) the barotropic model 
gives under-displacement compared to observation. 

For wave 3 there is a curious but consistent pattern at 
latitudes 30 and 40N. The barotropic model gives con- 
sistent under-displacement as compared to observation. 

The opposite conclusion at latitude 70N appears to have 
moderate significance, that is, a 12.4% "chance-probability."' 
At latitudes 50 and 60N, the distribution of signs appears 


to be completely random. 
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ae Conclusions. 


These statistical studies of the FNWF 500-mb prognoses have shown a 


number of significant results. Some of these results are given below. 


(a) 


(b) 


(c) 


More than 60% of the variability of the 48-hr correction field 
is associated with correction waves 1, 2, 3 with the former 
taking on a consistently greater proportion with increasing 
latitude. 

There is a tendency for above and below normal heights to be 
perpetuated in the subsequent 48-hr forecast. 

Generally in the low latitudes (30 through 50N) the ultra-long 
waves must be displaced to the east of their prognostic 
location, while the reverse seems to be true at latitudes 60 


and 7ON. 
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APPENDIX 


Histograms of amplitude and phase shift for correction waves 
accounting for more than 10% of the latitudinal variance of the wave 
(figures 1 through 23). For descriptions of these figures and appro- 


priate page numbers, refer to the list of figures on page iv. 
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Figure "| 
Wave No. J ; Latitude 20° North 
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Figure 3 
Wave No. Ll , Latitude +0° North 
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| Figure Lf 
Wave No. 1 ; Latitude 50° North 
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Figure 5 
Wave No.1, Latitude 60° North 


: Mean A = 180 ft. 
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Fi gune 6 
Wave No.1, Latitude 70° North 
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Figure i 
Wave No.2 , Latitude 20° North 
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Figure 8 
Wave No.2, Latitude 30° North 
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Figure 7 
Wave No.2 , Latitude 40° North 
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Figure 10 
Wave No. 2 F Latitude 50° North 
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Figure 14 
Wave No.2, Latitude GO North 
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Figure 12 
Wave No. 2 4 Latitude TO North 
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Figure 13 
Wave No.3, Latitude 20° North 
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Meagan A= 79+ ft. 
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Prairie fF 
Wave No.3 , Latitude 30° North 
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Figure 15 
Wave No. 3 ‘ Latitude 40° North 
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Figure 16 
Wave No. ie Latitude 50° North 
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Figure 17 
Wave No. 3 Latitude 60 North 





+ Q 

She 5 SB @ wl a Se a 

mee ee ss $$ 2S 8 es 
Amplitude A 


Mean Q. =+12° 





Phase Shif t - 
-31- 








Figure 18 
Wave No. 3 5 Latitude 70° North 
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Figure 19 
Wave No. 4 5 Latitude 20° North 
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Figure 20 
Wave No. 4+ j Latitude 30° North 
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| Figure 2] 
Wave No. r , Latitude 40° North 
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Figure FD, 
Wave No. + ; Latitude 50 North 
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Figure 23 
Wave No. 6 ; Merit acde Oe North 
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